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This paper outlines the Teaching Research approach to designing instructional 
simulation systems, a three-phase approach which involves (1) determining what to 
teach, (2) determining how best It might be taught, and (3) validating the system. An 
effort Is made to "expose the vital decision points" in each of the lo steps listed: (1) 
Define the instructional problem, (2) Describe the operational educational system, (3) 
Relate the operational system to the problem, (4) Specify objectives in behavioral 
terms, (5) Generate criterion measures, (6) Determine appropriateness of simulation. 
(7) Determine type of simulation required (interpersonal-ascendent simulation, machine 
or media-ascendent simulation, or nonsimulation games), (8) Develop specifications for 
simulation experience, (9) Develop simulation s vs tern prototype, (10) Try out prototype 
system, (11) Modify the prototype system, (1^) Conduct field trial, (13) Make further 
modifications to the system deemed appropriate from field trial evidence. Included in 
the Step 6 outline are a list of situations in which simulation may be a useful, 
cost-justified method and a list of arguments against simulation. A table for use in 
Step 7 presents the relative advantages (in terms of 18 instructional factors) of 
each of three types of simulation techniques. Four references are listed. (JS) 
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The purpose of this paper is to outline the approach of 
designing instructional simulation systems developed at Teaching 
Research, Detailed step-by-step explanations are beyond the 
scope of the present paper. They are available elsewhere 
(Crawford and Twelker, 1969). However, the thirteen phases of 
simulation design will be summarized, and an effort will be made 
to expose the vital decision points that confront the designer 
as he develops simulation experiences. 



A Rationale for the Design of Instructional Simulation Systems 

In designing an instructional simulation system, or any 
instructional system, for that matter, it is useful to think of 
a gap — the difference between the learner, where he is before 
instruction and after instruction. Before instruction, we assume 
that he lacks some knowledges or skills necessary to perform satis- 
factorily in an operational situation. After instruction, we assume 
that ho possesses these skills. Our problem is to specify the 
learning conditions necessary to bridge the gap between the learner's 
initial repertoire and final criterion repertoire. 

How best are these Instructional conditions specified? Are 
there instructional methods effective in all kinds of learning 
activities? To be certain, there are some general rules of thumb > 
that seem to hold in a variety of conditions , such as the provision 
for proper feedback, active participation, spaced practice, and 
so forth. Yet, it is clear that these guides do not lead us far 
enough down the road of instructional specification to be of much 
help at this stage in our technology. Too many decisions must be 
made in the course of specifying instructional conditions that 
cannot be answered by examining past research, theory, or intuition. 
Decisions must be made in the best manner possible, and this re- 
quirement has in large part prompted the approach to be discussed 
below. This approach may be summarized as; (1) determining what 
shall be taught; (2) determining how best it might be taught; 

(3) validating the system. 

The word "system*' used above has a special connotation and points 
up the fact that a simulation experience should not be conceived 
of as an Isolated experience taken out of the context of the over- 
all Instruction. The term, "simulation system" Infers that the 
simulation component of the system is accompanied by other "non- 
simulation" components. The components describe what curricular 
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unlts prBCcdSj accoinpfiny, &nd follow ths dctusi slinulfltion Gxcrcls©# 
Also, the word "system" denotes an interrelated set of components 
ranging from media and manuals tC) student learning materials. 

Specific Steps in Designing Instructional Simulation Systems^ 

Step 1. Define Instructional problem 

Before one can Improve instruction, he must step bade and 
examine in broad terms what preceded his decision to develop 
a new instructional system, and what might follow if his 
intentions were realized. What condition has motivated his 
tampering with the statiis quo-* why does he believe that 
intervention can improve the conditions? What is the . 
problem? What are the proposed solutions to the problem? 

What information led to the definition of this problem? In 
addition to defining the problem, the designer should make 
a thorough analysis of the context in which the system is 
to operate. 

Step 2. Describe the operational educational system 

Why analyze the operational system? What is suitable for one 
set of objectives taught in a given environment may not be 
effective for the same objectives taught in a different en- 
vironment that has different constraints placed upon it. For 
example, an excellent instructional system that is designed 
for teaching one child at a time may not be appropriate for 
teaching two or more simultaneously. The constraints of the 
system in which the designer expects to operate must be des- 
cribed. In analyzing the operational system, the designer 
must define: 

. Learners for whom the system is being designed (target 
group). 

Number of personnel avall^le to him on the project 
(man power) , 

Supporting equipment (machines) , 

Personnel scheduling, available curriculum material, 
description of course limits, and developmental time 
(procedures and materials) , 

Administrative limits, (management). 



1 



The thirteen steps arc 



summarized in figure 1. 



m 



3 



I 1. Define 

Instruction 



DETERMINING TIHAT 



TO TEACH 



f 



2 . 



Describe the 
Operational 
Educational 
System 



3. Relate Operat lonal 
System to Instruc 
tlonal Problem 



tlonal I 

struc- I 

em 1 



*** ■ 
4 


4. Specify 


J5. Generate 1 




Behavioral 


^ Criterion 


1 

1 ^ _ 


Obi ect Ives 


Measures I 
1 



DETERMINING HOW 
BEST IT MIGHT 



6. Determine Appropriateness 
Of Simulation 

— . 

1 7. Determine Type of 

Simulation Required | 



BE TAUGHT 


Develop Specifications 
For 






Simulation Exnerience 





9. Develop Simulation 
System Prototype 




10. Try-out Simulation 
System Prototype 




11. Modify 

Simulation 
System 
Prototype 











VALIDATING THE 



SYSTEM 



12. Conduct Field 
Trial - 


• 


■ ♦ 


13. Make Further 
Modifications 







Figure 1. 

Steps In the Design of an Instructional Simulation System 



ERIC 



-A- 



Facllities (setting) , 

Money available for the ongoing system and money avail- 
able for developing the new system (funds) , 

Instructional philosophy or orientation that guides the 
system as well as the designer (educational orientation). 

In summary, the designer should examine any element that he 
feels helps him to define the problem more clearly and to 
propose appropriate solutions. 

Step 3. Relate the operational system to the problem 

'fhe Inputs Identified above must be related to each other. 

It makes little sense to think of an educational problem In 
Isolation to the context In which It Is found. This relating 
of the Initially Identified problem with the system may cause 
the designer to redefine or restructure the problem. In some 
cases the designer will face the choice of delimiting his 
Interests and choosing certain aspects of the problems he has 
Identified. This Is based on the assumption that the more 
one knows about the system, the more problems will be perceived. 

Step 4. Specify oblectlves in behavioral terms 

There hM been some confusion regarding the "hows” or specify- 
ing behavioral objectives, whether they be enabling or terminal. 
Enabling objectives state In precise terms the specific know- 
ledge/skllls the student must learn In order to arrive at the 
terminal performance. Terminal objectives state In precise 
terms the behavior that the learner Is expected to esdilblt 
after Instruction. Where do objectives come from? Typically, 
the designer might begin by examining the unique key words, 
phrases, concepts, definitions, and rules that he frequently 
uses In the Instructional unit. He looks at their natural 
sequence. That Is, he analyzes a set of key concepts or 
definitions to see which are requisite for learning other 
key Ideas. He constructs a hierarchy of principles that 
tell him in what order these principles should be taught. 
Basically, this analysis Is used in the context of specify- 
ing what to teach, and requires the designer to choose some 
performance (that may or may not end up to be n terminal 
performance) and successively asking the following question: 
"What kind of capability would an Individual have to possess 
If he were able to perform this objective successfully, were 
we to give him only Instructions to do?" 

Where else does the designer look for objectives? He may 
check his final exams he has been giving, and attempt to 
assess the degree to which they really tap the skills desired 
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on the part of the student. He sees if there are more life-- 
like settings that could be developed that might more closely 
approximate the real skill that Is being taught and tested. 
Perhaps a case study, filmed situation, or taped dialogue 
would be a better assessment tool. The designer actually 
generates specifications for some of these tests. Then he 
asks the question, "Does that behavior satisfy me that the 
knowledge /skills have been taught?" The designer Infers 
knowledge from performance. 

One other point should be emphasized. Educational objectives 
may be thought of as either stated (Intentional) , or unstated 
(unintentional). Stated objectives are those determined by 
the designer to be Important and relevent to his problem. 
Unstated objectives are those which are not verbalized by 
the designer, but which may be just as appropriate as those 
stated. In designing Instructional simulation experiences, 
where vivid experience is the ke 3 mote rather than reported 
experience. It Is especially Important that unstated objectives 
are considered. For example, extreme competition In a simu- 
lation game may produce the desired stated objectives, but at 
the risk of promoting dishonesty, thus not fulfilling an un- 
stated objective regarding proper Interpersonal behavior. 

Step 5. Generate criterion measures 

Simultaneous with determining behavioral objectives is the 
development of criterion measures. These take two forms: 

(1) terminal performance measures, and (2) enabling per- 
formance measures. The measures for assessing terminal 
performance determine whether or not the stated outcome 
behaviors were acquired by the learner as a result of the 
Instructional experience. The measures for assessing 
enabling performance determine whether or not prerequisite 
behavior, necessary for adequate performance on the terminal 
objectives, have been acquired during Instruction. Again, 
the designer should pay some attention to generating measure- 
ment Insurements for unstated objectives. 

Step 6. Determine appropriateness of simulation 

Simulation has several advantages over more conventional forms 
of Instruction, althou^ cost may be more. Seven possibilities 
In which simulation may offer a useful and cost - justifiable 
alternative ere: 

1. Simulations are appropriate when objectives emphasize 
emotional or attltudlnal outcomes; 

2. Simulations Integrate affective and cognitive behavior; 
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3. Simulations initiate sustained learner activity and 
V motivation ; 

4. When the objective is to represent a social or man- 
machine system In such a vjay that the learner must 
interact with It, the system will react to the 
learner's moves, and the learner can discover the 
effects of alternative decisions, simulation Is 
useful; 

5. Simulation, in which a high degree of commitment 
may be Introduced, Is useful when emphasis Is upon 
Incorporation of the behavior desired. within the 
personal domain of the learner; 

6. Simulations provide an Interest - sustaining mode 
that Is particularly useful for exercising behavior, 
particularly under a variety of contexts; 

7. Simulation Is a most powerful means of placing a 
learner Into a desired "set" or "perceptual frame" 
to sensitize and direct him. 

On the other hand, there are some arguments against the use 
of simulation: 

1. Simulation Is not so efficient when It comes to the 
acquisition of cognitive knowledge as measured by 
typical tests; 

2. Simulation may coat more than conventional types 
of Instruction; 

3. More Information can be presented in less time by 
more traditional means of Instruction; 

4. Simulations, particularly the learning game variety, 
often Introduce considerable clianges In classroom 
noise level, physical movement, and teacher role 
that are highly suspect to some Instructors; 

5. Simulations are often difficult to evaluate because 
of the human processes that are modeled. 

Step 7. Determine type of simulation required 

If a decision has been reached to consider the use of simu- 
lation, the next set of decisions relate to the kind, or 
the attributes, of the simulation to be designed. The 
three major possibilities are: Interpersonal-ascendent 

simulation, machine /media-ascendent simulation, and non- 
simulation games. 



Interpersonal-ascendent simulation refers to the role playing 
and decision making, player-interacting simulations as typically 
found in such games as Consumer, Crisis, and Manchester. Inter- 
actions between learners carry a large shares of the Instructional 
burden. 

Machlne-or media-ascendent simulations are characterized by the 
Instructional burden being carried largely by media (for example, 
slide-tapes, films, programed Instruction, computer output, and 
so forth.) Examples Include flight trainers, systems trainers 
such as weapons systems simulators used by the military for sub- 
marine crew training, computer-based business games and classroom 
simulation (Twelker, 1967; Crulckshank, et. al. 1967). 

The third category non- -simulation games. Is Included, despite 
Its non-sequlter label, largely because of the number of learn- 
ing games that are being developed that do not simulate a model 
of reality. Such game. Includes the Nova game: W£f*n*Proof, 

On-sets, and Equations. These games certainly bring some of 
the advantages of simulation games to Instruction, but do not 
simulate any social or physlccd system. Yet, they do provide 
Involvement on the part of the learner In the application of 
concepts and principles drawn from formal disciplines. 

Table 1 presents the advantages of each type of simulation 
technique., It should be noted that the advantages listed are 
relative advantages and do not preclude the possibility of one 
or another type of simulation being adequate In any ^Iven-, 
situation. 

Step 8. Develop specifications for simulation experience 

A common error that novice simulation designers make Is to 
assume that the simulation exercise represents reality per se. 
They fall to realize that the simulation Is not based on reality 
directly, but on a model or theory of reality. In other words, 
the model Is a representation that Is In some way removed from 
reality. It might be appropriate to say that a simulation will 
only be as good as the model on which It Is based. .The model 
Is usually stated In general terms and Includes many variables 
that may be deleted or altered In the simulation, ^us, the 
simulation Is a representation of the model, but not an exact 
Image. Changes have occurred. It bahooves the simulation 
designer to construct or use the best fitting model he can so 
that he subsequently builds a fdlr chance of representing the 
relevant aspects of reality adequately. If the model Is not 
a good representation of reality, that Is, It distorts reality 
or omits relevant aspects of reality, and the simulation designer 
does not recognize this, the simulation has little chance of 
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Table 1 - Advantages of Each Type of Simulation 
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Ixistructlng learners in the appropriate behavior. The 
relationship between reality, the model, and the simulation 
are graphically presented in Figure 2. 

Step 9. Develop simulation system pr o totype 

At this point, a good share of the work of simulation system 
design has been accomplished, and the "fun” of building the 
system begins. The main task Is that of translating instruc- 
tional "blue prints" into prototype. The more complete and 
thought out the blueprints, the faster and easier the develop- 
ment. 

Step 10. Tryout simulation system prototype 

An empirical tryout of this system Is mandatory. The tryout 
Is limited in nature. If possible small groups of learners, 
or even one learner at a time If appropriate, are taken 
through the system by the designer. Close monitoring of 
the learners Is undertaken. Analysis of the system Is not 
limited to this. Learners may be requested to verbalise 
problems with the materials, arid suggest alternate strategies. 
It should be noted that the limited tryout of a system such as 
a simulation game may look quite different than a tryout of 
the media-ascendent simulation. Video taping of simulation 
game prototypes Is an extremely effective vay to capture 
activity for later analysis with a select group of learners 
sitting with the designers. Sometimes, a simulation may be 
tried out on colleagues before using learners that represent 
the target group so that responsible criticism may be obtained. 

Step 11. Modify the simulation system prototype 

Three major decisions are made during this step: (1) If 

the system seems appropriate for obtaining the stated 
objectives, how can It be Improved? (2) If the system 
does not seem to be appropriate for obtaining the stated 
objectives, how can It be changed? (3) If the system does 
not seem appropriate for obtaining the stated objectives, 
should It be discarded in favor of a non-slmulatlon system? 

Step 12. Conduct field trial 

The field trial serves to aid the designer In determining 
if his newly developed system Is capable of standing by 
Itself, that is, being used in the field under operational 
conditions by members of target population. Designers often 
neglect this crucial step, reasoning that "since I was 
successful In using the system, everyone else can use it 
now”. The safest thing a designer could do is subject his 
system to a trial under field conditions. When this Is 
done, the designer may wish to collect data concerning 
the stated outcomes as well as the unstated outcomes. In 
some cases, the designer might consider securing the services 
of a third-part evaluation team to conduct the field trial . 
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SIMULATION GAMES AND EXERCISES 




Figure 2. 

Graphical relationship between 
reality, models, and simulations 
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Step 11. Make further modlficatirus to the system deemed appropriate 
from field trial evidence 

When this point is reached, jit is hoped that few ’’bugs” 
are found in the system as detected during the field 
trial. If the previous steps have been executed In 
excellent manner, the field trial will Indicate improve- 
ment, not major changes. At this tlme^ the designer 
may also begin investigating ways to disseminate his 
system. 



A Final Word 

Sarane Boocock and E. 0. Schlld state In their book on 
Simulation Games that "simulation design is not only not a science, 
it is hardly a craft, but rather an ’art’ in the sense that we 
have no explicit rules to transmit." (Boocock and Schlld, 1968, 
p. 266) Others have made essentially the same statement of 
mcdla-ascendent simulation. This position can not be argued. 
Further, the guidelines offered above certainly are one step In 
the right direction as meaningful research directions may be 
specified In the context of the development of simulation 
exercises . 
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